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Human-Computer Interfaces Incorporating Haptics and Path-based 

Interaction 

Cross Reference to Related Applications 

This application claims the benefit of U.S. Provisional Application 60/431 ,060, "Human- 
Computer Interfaces Incorporating Haptics," filed on 12/05/2002, incorporated herein by 
reference. 

Background of the Invention 
[0001] This invention relates to the field of haptic human-computer interfaces, specifically to 

methods and apparatuses making haptic interaction more efficient or more realistic. 

[0002] Computing technology has seen a many-fold increase in capability in recent years. 

Processors work at ever higher rates; memories are ever larger and always faster; mass 

5 storage is larger and cheaper every year. Computers now are essential elements in many 

aspects of life, and are often used to present three-dimensional worlds to users, in everything 

from games to scientific visualization. 

[0003] The interface between the user and the computer has not seen the same rate of 
change. Screen windows, keyboard, monitor, and mouse are the standard, and have seen little 

10 change since their introduction. Many computers are purchased with great study as to 

processor speed, memory size, and disk space. Often, little thought is given to the human- 
computer interface, although most of the user's experience with the computer will be dominated 
by the interface (rarely does a user spend significant time waiting for a computer to calculate, 
while every interaction must use the human-computer interface). 

15 [0004] As computers continue to increase in capability, the human-computer interface becomes 
increasingly important. The effective bandwidth of communication with the user will not be 
sufficient using only the traditional mouse and keyboard for input and monitor and speakers for 
output. More capable interface support will be desired to accommodate more complex and 
demanding applications. For example, six degree of freedom input devices, force and tactile 

20 feedback devices, three dimensional sound, and stereo or holographic displays can improve the 
human-computer interface. 
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[0005] As these new interface capabilities become available, new interface methods are 
needed to fully utilize new modes of human-computer communication enabled. Specifically, 
new methods of interaction can use the additional human-computer communication paths to 
supplement or supplant conventional communication paths, freeing up traditional keyboard 
5 input and visual feedback bandwidth. The use of force feedback, or haptics, can be especially 
useful in allowing a user to feel parts of the interface, reducing the need for a user to visually 
manage interface characteristics that can be managed by feel. Users interfacing with non- 
computer tasks routinely exploit the combination of visual and haptic feedback (seeing one side 
of a task while feeling the other); bringing this sensory combination into human-computer 
10 interfaces can make such interfaces more efficient and more intuitive for the user. Accordingly, 
there is a need for new methods of human-computer interfacing that make appropriate use of 
haptic and visual feedback. 

Summary of the Invention 
[0006] The present invention comprises a method of providing an efficient interaction with a 

15 user of a human-computer interface. The method comprises establishing two paths: a device 
fundamental path and an object fundamental path. The two paths, which can comprise different 
geometric figures, are related by the interface in a defined correspondence. Motion by the user 
of an input device along the device fundamental path can be detected by the interface, and 
used to cause motion of an object in the computer application along the object fundamental 

20 path. 

[0007] The interface can also detect off-path motion of the input device. The interface, in some 
embodiments, can affect characteristics of the object or of other parts of the application 
responsive to such off-path motion. For example, the interface can change the angle or other 
property of an object responsive to off-path motion of the input device. 

25 [0008] The interface can also apply forces to an input device responsive to such off-path 

motion of the device. For example, the interface can apply force resisting off-path motion of the 
device, providing the user feedback. This feedback can guide the user to motion along the 
device fundamental path, and can allow the user to control an aspect (such as angle) of the 
application by control of the off-path force the user applies to the input device. 

30 [0009] Advantages and novel features will become apparent to those skilled in the art upon 
examination of the following description or may be learned by practice of the invention. The 
objects and advantages of the invention may be realized and attained by means of the 
instrumentalities and combinations particularly pointed out in the appended claims. 
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Description of the Figures 
[0010] The accompanying drawings, which are incorporated into and form part of the 

specification, illustrate embodiments of the invention and, together with the description, serve to 

explain the principles of the invention. 

5 [0011] Figure 1 is a schematic representation of an input device and a corresponding object in 

an application. 

Figure 2 is a schematic representation of a device fundamental path and corresponding object 
fundamental path. 

Figure 3 is a schematic representation of a device fundamental path comprising a surface. 
10 Figure 4 is a schematic representation of an example device fundamental path and 
corresponding object fundamental path. 

Figure 5 is a schematic representation of a device fundamental path and a motion-initiation 
region. 

Figure 6 is a schematic representation of a device fundamental path initiated by a motion- 
15 initiation actuation. 

Figure 7 is a flow diagram of one mode of operation of an interface according to the present 
invention. 

Figure 8 is a flow diagram of one mode of operation of an interface according to the present 
invention. 

20 Figures 9(a,b,c,d) comprise a schematic diagram of several steps in an interface according to 
the present invention applied to golf simulation. 

Figures 10(a,b,c,d) comprise a schematic diagram of several steps in an interface according to 
the present invention applied to pool or billiards simulation 

Detailed Description of the Invention 
25 [0012] The present invention comprises methods and apparatuses related to communication 

with a user, with example applications in computer games. The present invention is amenable 
to use with 3 dimensional positional input devices with force feedback, though the present 
invention is useful with other input devices as well. Input devices with force feedback, or 
"haptic devices," can provide user inputs in terms of three-dimensional position (i.e., X, Y & Z) 
30 and, sometimes, orientation (i.e., thetal, theta2 & theta3). The devices can provide three- 
dimensional forces. These forces can comprise 3 degrees-of-freedom (i.e., X, Y, & Z) and, 
sometimes, can also accommodate rotational forces (i.e., thetal, theta2 & theta3). The "range 
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of motion" of an input device is the volume or area throughout which the input device can 
move, limited by, as examples, the geometry of the device or of an interface surface (such as a 
mouse pad). The range of motion can also be that portion of the device range of motion that 
can be efficiently used by the user. 
5 [0013] The description herein assumes that a user of a human-computer interface controls a 
user input device, for example a haptic device such as discussed above. The input device is 
moveable by the user throughout a number of positions, the collection of which is termed the 
"range of motion" of the input device. The human-computer interface allows the user to 
interact with an application on the computer, for example a computer game. Objects and 

10 actions in the application can be communicated to the user in various manners, including as 
examples by visual display and by sound generation. A human-computer interface according to 
the present invention affords to the user an improved control of an object in the application. 
[0014] Haptic interfaces can be connected with visual images. Realistic visual images are 
available from capture of real-world images and from computer animation. Realistic visual 

15 images, however, can comprise vary complex motion. A golf swing, for example, can involve 
many continuously changing angles and arcs as the player moves to effect the travel of the 
club. Each action, moreover, can be different from all others. For example, each golfer's swing 
can differ from that of other golfers, and even a single golfer can present different swings 
depending on the club and game situation. Providing haptic representations of such a large 

20 number of complex motions can be too costly for many applications. 

[0015] The visual sensory path in humans, however, generally overrides the proprioceptive and 
kinesthic sensory paths. This means that the human perception of an environment is generally 
controlled by the visual information, with other information providing additional realism and 
additional information, and any conflicts resolved in favor of the visual information. A haptic 

25 interface can, therefore, provide a simplified haptic representation of a complex motion and still 
provide a user with a full sense of realism. In gaming applications, for example, a single simple 
haptic representation can be used in connection with many varied and complex visual 
representations. A single curved haptic path, for example, can be used as the haptic 
counterpart to realistic golf swings of different golfers in a variety of situations. 

30 [0016] Figure 1 is an illustration of a computer input device 101 in communication with a 

computer 103. The computer 103 controls a display 104. A user (not shown) of the system can 
control the input device 101 , for example by moving a specific point 102 on the input 
device 101. Motion of the specific point 102 can be communicated to the computer 103, which 
can provide a human-computer interface that provides specific computer actions responsive to 
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specific signals from the input device. The computer 103 can cause the display 104 to provide 
appropriate visual feedback to the user. As an example, the computer 103 can provide an 
application comprising a table 105 and an object 106 thereon. The table 105, object 106, and 
their relative positions can be communicated to the user via the display 104. The human- 
5 computer interface can allow the position of the object 106 in the application to change 

responsive to changes in position of the point 102 on the user input device 101. For example, 
the user can move the point 103 to the left, and human-computer interface can cause the 
representation of the object 106 to move to the left in the display 105. The above is intended as 
a simplified description; those skilled in the art will appreciate the invention's applicability to 

10 more complex applications and motions. 

[0017] In some applications, the path desired for the object in the application can be different 
than the path desired for the user input device. For example, the path followed by the head of a 
golf club can be complex, and can be vary from golfer to golfer. A computer application that 
displays the path of a golf club might display motion that closely approximates the actual path 

15 followed, even mimicking the visual effect of different golfers' swings. Requiring the user to 
move the input device in a manner that exactly corresponds to the actual path can require 
overly difficult user control, and can result in decreased effectiveness of the human-computer 
interface. 

[0018] The present invention provides an "object fundamental path," which is a path in the 
20 application that the object is expected to follow (in some applications, the object must follow the 
object fundamental path, in others, the object can stray from the object fundamental path). The 
present invention also provides a "device fundamental path," which is a path in the range of 
motion of the input device that has a defined correspondence to the object fundamental path. 
The description below generally discusses a single device path in correspondence with a single 
25 object path; the invention is also applicable with multiple device paths corresponding to a single 
object path (e.g.. there are several ways to effect the desired object motion); with a single 
device path corresponding to multiple object paths (e.g., there are several objects that can be 
controlled with a with motion along a single defined path); and with multiple device paths each 
mapped to one or more object paths (e.g., there are multiple objects that can be controlled, 
30 each according to one or more device paths). The object and device paths can also depend on 
the state of the application (e.g., the object might move in one manner when the application is 
in a first state, and in a second manner when the application is in a second state). 
[0019] Figure 2 is an illustration of two example paths and their correspondence. An input 
device 201 allows a user to control the position of a point 202. The point 202 can move along a 
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device fundamental path 21 1 in the device's range of motion. Motion of the point 202 can 
viewed as comprising a component 213 along the device fundamental path 21 1 and a 
component 214 not along the device fundamental path 21 1. The human-computer interface can 
provide a correspondence between motion of the point 202 and motion of an object 206 in the 
5 application, shown in the figure on a display 204 controlled by the interface. The interface can 
define an object fundamental path 222 within the application. Motion of the point 202 along the 
device fundamental path 213 can be mapped by the interface to motion of the object 206 along 
the object fundamental path 223. Motion of the point 202 not along the device fundamental 
path 214 can be accommodated as described below. Note that the correspondence between 
10 the two paths can be established by the interface, so that, for example, the object fundamental 
path can comprise a complex curve, well-suited for realistic display, while the device 
fundamental path can comprise a simple parabola, well-suited for efficient computer processing 
and efficient user control. 

[0020] The interface can accommodate various effects of motion of the device not along the 

15 device fundamental path. As an example, the interface can apply a force to the input device, 
resisting off-path motion. The user can therefore be constrained to follow the device path, 
allowing the user to effectively control an object along a complex path by simply following the 
leading of the forces applied by the interface. As another example, the interface can change 
characteristics of the object in the application responsive to motion not along the device path, 

20 for example changing the angle of a golf club head. The user can therefore control an object 
along a complex path, and control characteristics of the object by off-path motion. As another 
example, the interface can change how an object interacts with other parts of the application 
based on off-path motion. The interface can also change the visual representation of the object 
according to off-path motion, for example by changing the size, shape, or color of the visual 

25 representation to indicate to the user off-path motion. 

[0021] The interface can also supply forces to the input device responsive to the object's 
motion in the application. For example, a portion of the object path can encounter various 
situations (e.g., a car encountering a rough road or an obstacle, a golf club encountering sand 
or a ball). The interface can apply forces to the input device to communicate to the user such 

30 situations. For example, the interface can apply a friction force resisting on-path motion of the 
input device when the object encounters a situation that resists its on-path motion in the 
application. The interface can also apply forces to the input device to reflect interactions of the 
object with the application. For example, the interface can apply forces to the input device to 
provide a feel for the effects of wind blowing in the application, or of other objects in the 
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application striking the object. The interface can also apply forces to the device that oppose 
motion of the device beyond boundaries of the device path, giving the user a force-based sense 
of the end of the path and lessening the possibility of physical damage to the input device from 
forceful movement at the extremes of its range of motion. For example, the interface can apply 
5 a force opposing motion of the input device at the end of a path mapped to a golf swing. The 
interface can also apply forces to the device to provide the user a force-based sense of motion 
of the object in the application. For example, the interface can apply forces to provide the user 
with a sense of inertia and momentum of the object as it moves in the application. The speed of 
the motion of the object along the object path can also affect the object's interaction with other 
10 parts of the application. For example, a quickly moving pool cue object can cause balls in the 
application to move faster than a slowly moving pool cue. 

[0022] Each path can comprise any shape suitable for the application or input device. Figure 2 
illustrated a two-dimensional path; three-dimensional paths can also be accommodated. 
Figure 3 is an illustration of a path defined to be a surface 301 . Motion "along the path" with 

15 such a path can be any motion in the surface. An example path 302 that can be traveled by an 
input device 303 is shown. The interface can apply forces to the input device resisting any 
motion normal to the surface, keeping the input device in the surface 301. The surface 301 can 
correspond to a object path that is also a surface, in which case motion of the input device 
within the device surface can correspond to motion of the object within the object surface. The 

20 surface can also correspond to an object path that is a curve, in which case motion within the 
device surface can be ignored, or can be used to control another aspect of the application. The 
correspondence can comprise various combinations; for example part of the device path can 
comprise a surface while part can comprise a curve to allow specific object behaviors to be 
accommodated. 

25 [0023] The interface can also use the correspondence between the paths to help make efficient 
use of the input device's range of motion. As an example, the interface can allow a transition to 
a path-based interaction only when the input device is in a configuration such that allowable or 
expected motion in the path-based interaction will be within the range of motion of the input 
device. As another example, the interface can map the current position of the input device to a 

30 place on the device path such that allowable or expected motion in the path-based interaction 
will be within the range of motion of the input device (e.g., map to the middle of a parabola if the 
device is near the middle of the range of motion; map to an end if the device is near a boundary 
of its range of motion). As another example, the interface can apply forces to the input device to 
move it to a place in its range of motion when the path-based interaction is begun, such that 
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subsequent motion will be within the range of motion of the input device. In some applications, 
the interface can apply such forces constantly to provide the user with a force-based sense of 
the appropriate place to begin the path-based interaction (e.g., continuously pulling the user to 
a point at which an object in the application can be grasped and manipulated according to a 
5 path-based interaction). 

[0024] Figure 4 is a schematic representation of an interface according to the present invention 
adapted for use in a golf game. A device fundamental path comprises a surface 401, with a 
preferred path comprising a curve 402 lying on the surface 401. A user can control an input 
device 403, with components of motion along dimensions labeled for convenience as z-dev 

10 along the curve 402, x-dev orthogonal to the curve 402 and in the surface 401 , and y-dev 
normal to the surface 401 . A corresponding object, the head 412 of a golf club 41 1 in the 
application, can be represented to the user via a display 416. An object fundamental path is 
defined as a curve 413 in the application space and, as discussed above, can be the same or 
different shape as the curve 402 of the device fundamental path. Motion of the object 412 can 

15 be labeled for convenience as z-obj along the curve 413, x-obj and y-obj orthogonal to the 
cun/e 413 and to each other. Sand 415 and a golf ball 414 are also represented in the 
application at defined locations relative to the object fundamental path 413. 
[0025] In operation, the interface can apply a large force opposing any device motion 
component along the y dimension, keeping the input device motion along the surface. Any y- 

20 dev motion in opposition to the y-dev force can be ignored for determining the actions in the 
application. The interface can apply a smaller force opposing any motion component along the 
X dimension, encouraging the user to keep the input device along the curve 402 but allowing 
off-curve (but still in surface) motion. Any x-dev motion in opposition to the x-dev force can be 
used by the interface to establish a tilt for the club head object 412, with the tilt value when the 

25 object 412 contacts the ball 414 used to determine a resulting trajectory of the ball. The 

interface can map device motion along z-dev to object motion along z-obj, allowing the user to 
control the golf club head 412 along its object path by controlling the input device along its path. 
[0026] The interface can also apply resistive forces opposing z-dev motion of the input 
device 403 when the object 412 moves to a position within the sand 415. It can also apply a 

30 force impulse when the object 412 moves to a position that indicates contact with the ball 414. 
The history of the input 403 device (e.g.. change over time, or speed), and correspondingly of 
the object 412, can be used to determine the impulse given to the ball 414 and the balPs 
resultant trajectory. 



010-03-002; ANDERSON; Page 8 



[0027] If the interface generally allows freedom of motion of the input device, then it can be 
important that the user be able to control and sense when the input device is on a device 
fundamental path. Figure 5 is a schematic representation of a mapping of an input device's 
range of motion that allows such control. A device fundamental path comprises a surface 501 
5 and curve 502, for example, like that discussed above. A portion of the range of motion of the 
input device is defined as a motion-initiation region 503. When the input device 504 is outside 
the motion-initiation region 503, then the interface provides a user interaction independent of 
the device fundamental path. When the user positions the input device 505 inside the motion- 
initiation region 503, the interface provides an interaction according to the device fundamental 

10 path 501. For example, the interface can apply forces to the input device 505 to urge it to a 
position 506 on the device fundamental path 502 (or "snap" to the path). 
[0028] Figure 6 is a schematic representation of another method allowing the user to reliably 
control entry into the fundamental path mode of interaction. The user is provided a switch 
which, when actuated, causes the interface to provide an interaction according to a device 

15 fundamental path. The switch can comprise, as examples, a button to press or release, a voice 
command to speak, a key to press or release, a defined motion of the input device (e.g., a tight 
circle motion) or any of many indication means known to those skilled in the art. The interface 
allows the user to move the input device, for example from a point 601 to another point 603. As 
long as the switch is not actuated, the interface does not provide the path interaction. In the 

20 figure, the user actuates the switch when the input device is at a third point 605. The interface 
then provides interaction according to a device fundamental path, shown in the figure 
comprising a curve 606. In the figure, the path begins at the point where the switch was 
actuated. The path can have an intermediate point where the switch was actuated, or the 
interface can apply forces to move the input device to a point in its range of motion that 

25 corresponds to a defined point on the device fundamental path. This can be useful if, for 
example, the device is in a configuration when the switch is actuated that does not 
accommodate the desired motion along the device fundamental path. The methods of Figures 5 
and 6 can be combined, and the switch actuation only effective when the input device is within a 
defined region of its range of motion (or, an object corresponding to the input device is within a 

30 defined region in the application). 

[0029] The interaction according to the fundamental path can also comprise a re-mapping of 
the range of motion of the input device. For example, the user can move the input device in a 
large portion of its range of motion to move around in the application space. A small portion of 
the application space can correspond to the path of an object whose interaction is according to 
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paths as described above. Initiating a path-based interaction can remap the input device's 
range of motion so that a large portion of the range of motion corresponds to the device path, 
allowing the user to use the larger range of motion to interact with the object than would have 
been available with a direct, unchanged correspondence between the input device and the 
5 application space. As a specific example, consider a basketball game, where the user is trying 
to throw the ball to a specific target (e.g., a basket or another player). For realistic visual 
communication, the target can be presented as small portion of the visible space. That same 
small portion, when translated into the range of motion of a haptic interaction device, can 
require undesirable or unachievable precision motion. The interface can recognize that the user 

10 is in contact with the ball. In that interface state, a large portion of the range of motion of the 
user can be mapped to the small portion of the application space around the intended target. 
Thus, the user can use coarser motion, better suited to the hand and haptic interaction device, 
to accomplish precise motion in the game. The path correspondence can scale angular or linear 
relationships to help the user to reach the desired goal. In the basketball example, the interface 

15 can transform small motion by the user to long motion in the game (to allow short throws to 
reach distant targets) and can transform large angles of the user motion to small angles in the 
game (to allow precise direction control for on-target throws). 

[0030] The response of the interface to off-path motion can also contribute to an effective user 
interaction. For example, it can be difficult for a user to accurately manipulate an input device to 

20 control a computer game; that can be part of the challenge, but can be frustrating for 

beginners. Conventional interfaces make all user input trivial, and rely on decisions and timing 
for challenge. Haptic interaction devices, and non-haptic interaction devices with multiple 
degrees of freedom, can allow more realistic, and more challenging, input. However, the 
interface must accommodate varying user skill levels to present the desired challenge. 

25 [0031] The interface can apply forces resisting off-path motion to assist the user in accurately 
moving the input device. The magnitude of the guiding forces can be varied according to the 
desired level of assistance; for example, the interface can provide a beginner mode where large 
guiding forces are applied even for small off-path motion, and an expert mode where smaller 
(or no) guiding forces are applied. As another example, the interface can apply forces that 

30 encourage off-axis motion to increase the difficulty by perturbing the user control of the input 

device. ; 

I 
I 
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Example Interface Implementation 

[0032] Figure 7 is a flow diagram of one mode of operation of an example interface according 
to the present invention. The mode is labeled "not moving," indicating that the user is not 
moving the input device along a device path in correspondence with an object path. The 
5 interface determines whether the user has positioned a cursor within a motion initiation 
region 701. Once the cursor is in the motion initiation region, then the interface determines 
whether a switch has been activated 702. Once the switch has been activated while the cursor 
is in the motion initiation region, the interface establishes a position of the input device along 
the device path 703, and sets the interface mode to "moving." 

10 [0033] Figure 8 is a flow diagram of another mode of operation of an example interface 

according to the present invention. The mode is labeled "moving," indicating that the user is 
moving the input device along a device path in correspondence with an object path. The 
interface verifies that the switch is activated 801 . If not, then the interface sets the mode to "not 
moving," as in Figure 7. If so, then the interface determines whether the object in the 

15 application is clear of application constraints 803. Constraints can be, for example, relationships 
between the object and other parts of the application that are inconsistent with the intended 
subsequent motion (e.g., a golf club that is already past the ball when the switch is actuated). If 
the object is not clear of application constraints, then the interface waits until the switch is 
activated and the device is clear. Once that condition is attained, then the interface tracks the 

20 position of the input device along a device path 803. The interface applies control forces to the 
user to reflect the desired device path interaction 804, such as the example force relationships 
described above. The interface maps the device position to the position and characteristics 
(e.g., rotation) of the object 805. The interface determines whether the object has moved to a 
position along the object path that indicates an interaction event, for example whether the 

25 object has contacted a target 806. If it has, then the interface applies an appropriate simulated 
force to the target, e.g., a force proportional to the speed of the object prior to impact 807. The 
interface can also apply a force to the input device to communicate the impact of the object with 
the target to the user via the input device 808. The interface can then set the interface mode to 
"not moving" and wait for another initiation of a path-based interaction 810. 

30 Golf Interface Example 

[0034] Figures 9(a,b,c,d) comprise a schematic diagram of several steps in an interface 
according to the present invention applied to golf simulation. In Figure 9a, the user can 
manipulate an input device 901 over a range of motion 910 thereof, but has not yet initiated a 
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path-based interaction to control a golf club object 902 in the application. The application 
comprises a display 91 1 of objects in the application such as a golf club object 902 and a golf 
ball object 905. 

[0035] In Figure 9b, the user has initiated a path-based interaction by moving the input 
5 device 901 to an appropriate region of its range of motion and pressing a switch 907. The 
interface has established a device path 903 in the range of motion 910 in correspondence with 
an object path 906 for the golf club object 902 in the application. The interface has also added a 
visual indication 904 of the establishment of the path-based interaction to the display of the 
object in the application. 

10 [0036] In Figure 9c, the user has moved the input device 901 to the right along the device 

path 903, and the interface has moved the golf club object 902 along the corresponding object 
path 906. The interface can apply forces to the input device 901 to encourage the user motion 
of the input device 901 to remain along the device path 903. The interface can establish a tilt or 
angle of the face of the golf club object 902 in the application based on motion of the input 

15 device 901 off the device path 903. The interface can also apply forces to the input device 901 
to simulate other forces that might be useful or informative from the application, for example 
forces to reflect simulated wind or other objects in the application. The golf club object 902 can 
be modeled by the interface as a weight attached to a point by a spring; the interface can apply 
forces to the input device 901 that are determined according to the weight-spring system. This 

20 can provide the user with realistic force sensation of motion without incurring problematic force 
profiles or interface instability. 

[0037] In Figure 9d, the user has moved the device 901 to the left along the device path 903, 
past the point where the object on the corresponding object path would contact the golf ball 
object 905 in the application. The interface has moved the golf club object 902 along the 

25 corresponding object path in the application, and has changed the display of the golf ball 

object 905 simulating the impact of the golf club object 902 with the golf ball 905. The simulated 
impact can reflect the speed of the golf club object 902 (which itself reflects the speed of the 
input device 901 due to the correspondence between the input device path 903 and the golf 
club object path 906). The simulated impact can also reflect directionality from a tilt or angle of 

30 the club face established from off-path motion of the input device 901 . 

Pool Interface Example 

[0038] Figures 10(a,b,c,d) comprise a schematic diagram of several steps in an interface 
according to the present invention applied to pool or billiards simulation. In Figure 10a, the user 
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can manipulate an input device 1001 over a range of motion thereof, but has not yet initiated a 
path-based interaction to control a pool cue club object 1002 in the application. The application 
comprises a display 1011 of objects in the application such as a pool cue object 1002 and a 
plurality of pool ball objects 1005. 
5 [0039] In Figure 10b, the user has initiated a path-based interaction by moving the input 
device 1001 to an appropriate region of its range of motion and pressing a switch 1007. The 
interface has established a device path 1003 in the range of motion in correspondence with an 
object path 1006 for the pool cue object 1002 in the application. The interface has also added a 
visual indication 1004 of the establishment of the path-based interaction to the display of the 

10 object in the application. 

[0040] In Figure 10c, the user has moved the input device 1001 toward the user (roughly 
downward in the figure) along the device path 1003, and the interface has moved the pool cue 
object 1001 along the corresponding object path 1006. The interface can apply forces to the 
input device 1001 to encourage the user motion of the input device 1001 to remain along the 

15 device path 1003. The interface can establish the orientation of the pool cue object 1002 in the 
application, and therefore the direction of the resulting shot, based on motion of the input 
device 1001 off the device path 1003. The interface can also apply forces to the input 
device 1001 to simulate other forces that might be useful or informative from the application, for 
example forces to reflect simulated friction or contact with the table. The pool cue object 1002 

20 can be modeled by the interface as a weight attached to a point by a spring; the interface can 
apply forces to the input device 1001 that are determined according to the weight-spring 
system. This can provide the user with realistic force sensation of motion without incurring 
problematic force profiles or interface instability. 

[0041] In Figure lOd, the user has moved the device 1001 away from the user (roughly upward 
25 in the figure) along the device path 1003, past the point where the tip of the pool cue 

object 1002 on the corresponding object path would contact the pool ball object 1005 in the 
application. The interface has moved the pool cue object 1002 along the corresponding object 
path in the application, and has changed the display of the pool ball object 1005 simulating the 
impact of the pool cue object 1002 with the pool ball 1005. The simulated impact can reflect the 
30 speed of the pool cue object 1002 (which itself reflects the speed of the input device 1001 due 
to the correspondence between the input device path 1003 and the pool cue object path 1006). 
The simulated impact can also reflect directionality of the pool cue established from off-path 
motion of the input device 1001 . 
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[0042] The particular sizes and equipment discussed above are cited merely to illustrate 
particular embodiments of the invention. It is contemplated that the use of the invention may 
involve components having different sizes and characteristics. It is intended that the scope of 
the invention be defined by the claims appended hereto. 
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